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Introduction 


Bloomquist. (I |, [2«, developed the concept of availability, * which is a measure of the 
overall usefulness of a spacecraft or spacecraft ’■ay load. Kruger and Norris [3] extended this 
idea and used it in determining a thermal-vacuum test optimization procedure. Their opti- 
mization procedure makes use of a “lost value'’ function which is based on average availabil- 
ity* and other test costs. The optimization procedure is an interactive computer program in 
wnich the user supplies certain parameters as inputs. These parameters include payload in. »rma- 
tion such as the number of compone r ts in the payload from which payload weight and payloud 
cost can be determined, length of the mission in days, the type of item (protoflight, first flight 
item, or follow-on), whether an expendable launch vehicle or Shuttle (STS; is involved, if *he 
latter, whether it is a Free-Flier or a Spacelab mission, the minimum and maximum test temper- 
atures, and various other data. 

One of the ideas central to the above optimization procedure is that of average utility which 
is calculated from instantaneous utility. Kruger and Norris [3] extended the concept of availabil- 
ity defined in Bloomquist [ 1 ] to make it dependent on the number of components in payload, 
mission duration, etc. 

Utility is thought of as the successfulness of a mission as compared to a perfect mission. A 
perfect mission is one in which no failures or anomalies occur. (The words “failure” and “anom- 
aly” are synonomous in the context of this report.) As a sequence of failures occur, the mission 
begins to degrade according to the seriousness or criticality of each failure. Utility is calculated 
from the observed occurrence of a random sequence of anomalies or types of failures by assigning 
a certain criticality to each of the failures in the sequence and then considering utility of the 


’While Bloomquist (lj. (2) and Kruger and Norris (3) have used the term “availability", that word in this report will be changed 
to “utility" because of the general usage of the tern, “availability" to mean other things in the field of reliability. 
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payload or spacecraft after any failure as the product of one minus the criticality term at the 
particular failure multiplied by the previous remaining utility. The instantanrous utility, u is de- 
fined as follows: 


U ■ ,11 d - D i) n| (1) 

Where; Dj denotes the criticality of a type i failure, 

ft is an index set for the various criticalities of failures that occur during space flight, and 
n( is the total number of failures for any particular type of criticality during any space 
flight or any combined number of space flights. 


In the above discussion, criticality is a predefined measurement of the percent of degradation 
caused by certain types of failures. 


Estimating Utility 

In order to estimate U, it is first necessary to define the criticality various types of failures 
that can occur during any particular space flight. It is important to note that measures of criti- 
cality are subjective measurements and may vary from mission to mission and may vary due to 
various types of payloads such as those for scientific versus applications missions. Bloomquist 
[ 1 ] uses five classes of criticalities and has studied the effects of failures on the degradation of 
space missions for 304 spacecrafts. Timmins [4], studied 57 (GSFC) spacecraft and classified the 
criticalities according to four classes. The data in reference [4] consists of 449 malfunctions and 
failures and considered mission and component criticality with and without redundancy. Since 
Timmins’ data involved GSFC spacecraft and GSFC thermal-vacuum test procedures bassd on 
these types of spacecraft, we use this data to define the various types of criticalities. This defini- 
tion considers a malfunction and a failure as both being anomalies and we use the data based on 
redundancy. We summarize the data in Table 1. 

In order to calculate U, we observe a sequence of failures or malfunctions, apply equation 
(1), and then calculate the utility at each stage of operation. This concept of utility is instantan- 
eous in the sense that one has the overall utility at the instant the failure occurs. 
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Table i 


Criticality Type 

Criticality 

Classification 

Range of the 
Percent Loss 
Due to Criticality 

Percentage of 
Malfunction 

Catastrophic 

D, 

100-90 

0.02 -Pr(Dj) 

Major Lon 

d 2 

90-50 

0.02-Pr(D 2 ) 

Substantial Loss 

d 3 

50-10 

0.1 1 -Pr(D 3 ) 

Minov Loss 

d 4 

10-0 

0.85 « Pr (D 4 ) 


As an example, consider the following sequence of failures (D 4 , D 4 , D 2 , D 3 ) which is a sub* 
set of various criticality types (D p D 2 , D 3 , D 4 ). 

The utility after three consecutive failures of the failure sequence isU * (1 - D 4 ) (1 - D 4 ) 

( 1 - D 2 ). In order to assign a numerical 'riue to U, we must assign a percent loss due to each 
criticality. One possible choice is to assign the mid-points of the ranges of the percent losses due 
to the types of criticalities. Therefore, D 4 * 0.05, D 3 » 0.30, D 2 * 0.70, and D 4 ■ 0.95. With 
those D’s, U « (1 - 0.05) (1 - 0.05) (1 - 0.70) » (0.95) 2 (0.3) ■ 0.27075 at the end of three 
failures. 

It can be seen that the value of U depends upon a random sequence of failures. Thus, there 
is no absolute model with which tc compare U (such as assuming the linear model in regression 
analysis) and then determining the degree of fit oy comparing the sum of squares due to regression 
to the total sum of squares. 

Establishing a Criterion for Goodness of Fit 

We next establish a criterion for making a comparison for goodness of fit for estimates of U. 
Assume that S is the underlying set for all measurement techniques for U determined by equation 

(I) . For Sj e S, Sj e S, we decide that measurement technique Sj is better than Sj if Sj outper- 
forms Sj. We use as a performance criteria (I) performance at each point or mode of failure and 

(II) measurement of the spread. We specify (I) by saying Sj outperforms Sj at the nth failure, if 
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the absolute value of the residual for the estimate Uj of U, is less than the absolute value of the 
residual for the estimate of Uj of U. In terms of events, we have a success, a failure, or a tie where 
a success means Sj outperforms Sj, a failure means Sj outperforms Sj, and a tie indicates equality 
of performance. If we exclude ties or use a randomization procedure to reclassify ties, we have a 
binomial structure which can be used to measure the performance at each point or mode of fail* 
urc. To specify a measurement of spread, we use the mean squared error (M.S.E.). 


To decide between selection procedure S( over Sj based on performance criteria I and II we 
establish the following decision table. 

Table 2 


Condition 

Decision 

(if) I: S* - Sj 


(and) II: (a) M.S.E. (Sj) - M.S.E. (S,) 

(then) estimation procedures are the same 

(b) M.S.E. (Sj) < M.S.E. (Sj) 

Sj is a better estimation procedure than Sj 

(c) M.S.E. (Sj) < M.S.E. (Sj) 

Sj is a better estimation procedure than Sj 

(if) I: Sj > Sj 


(and) II: (a) M.S.E. (S { ) - M.S.E. (S,) 

(then) Sj is a better estimation procedure 


than Sj 

(b) M.S.E. (S,)»M.S.E. (Sj) 

no conclusion 

(c) M.S.E. (Sj) < M.S.E. (Sj) 

Sj is a better estimation procedure than Sj 


In the above discussion we replace i by j in step II when Sj > Sj for step I. 

As in Kruger and Norris [3] , one obtains a estimate 0 of U by considering a measurement of 
overall criticality D* such that 

(1 - D*) n ® 0 ( 2 ) 

where n = total number of failures. 

By equating 0 to U, we have 
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Solving for D*, one obtains 

D* ■ I - exp < X) I — fin ( 1 - Di) 

i,i«0 L n 

where D| denotes the percentage loss for the i ,h type of criticality, and ft is the index set of de- 
fined criticalities. 

If one calculates D* for the set of all spacecraft, then the probability of the event Dj is 

n i 

Pr (Dj) 11 — where n ■ the total number of failures and n< ■ number of failures of the i tft type 
n 

of anomaly, (fin (1 - Dj)) is a weight of Pr (Dj). 

Since one is interested in a measurement of overall criticality, it is feasible to look at an 
average measurement or a class of estimates that measure D overall. Thus, one may calculate an 
estimate of overall criticality by using the classical definition of expected value. We thus have: 

E(D) - £ (Dj) • (Pr (Dj)) (5) 

left 

Since the definition of the percentage loss due to a particular type of criticality is subjective, 
we may obtain various estimates of E(D). As an example of various values that E(D) assumes, we 
consider the maximum, upper quartile, middle, lower quartile, and minimum points for the inter- 
vals that describe the percentage loss that is due to the various types of criticalities based on 
Table 1 . We summarize this information in Table 3. 

As a sample calculation, we have: 

E(j) (D) » (1.0X0.02) + (0.9) (0.02) + (0.50) (0.11) + (0.10) (0.85) * 0.178, 

and the other E(j) (D)’s are calculated in a similar manner using equation (5), Table 2, and the S 

j 

percentage of malfunction, P(Dj) given in Table 1. | 
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Tab|e 5 

Interval* Describing Percentage Loss Due to Criticality 


Max 

Upper 

Quartile 

Middle 

Lower 

Quartile 

Minimum 

(1) 

(2) 

(3) 

(4) 

(5) 

1.0 

0.975 

0.95 

0.925 

0.90 


0.80 

0.70 

0.60 

0.50 

0.50 

0.40 

0.30 

0.20 

0.10 

0.10 

0.075 

0.05 

0.025 

0 

E„>(D) 

E(2) (»> 

E(3) (D) 

E'4) (D) 

E(5) (D) 

0.178 

0.143 

0.109 

0.078 

0.039 


using P 1 * 0.02, P 2 ■ 0.02, P 3 ■ 0.1 1 , P, - 0.85 
where Pj * Pr (Dj). 


As seen from Table 3, the use of subjective probability enables one to consider various 
bounds and ranges of values for D| and hence for measurements of E(D). Possible applications 
of the table extend to determining the overall criticality E(D) as a function of the number of 
components in a spacecraft. If it is believed or it can be shown that when the number of com- 
ponents that comprise a r ^acecraft or payload increases, the overall criticality decreases, then one 
may make a subjective judgment on the choice of £(D), choosing the lower quartile measurement 
for a greater number of components and the upper quartile for fewer number of components. 

If one uses this concept for future space flight missions such as Space Shuttle, then it would be 
feasible to study and redefine the types of criticalities and the range of the percent loss due to 
criticalities. In fact, Tables 1 and 2 should continually be studied and upgraded as one changes 
missions or enlarges the data banks from new missions. 

A comparison was conducted on data from 3 1 spacecraft from PRC data base that were 
common to the GSFC data base to see how D* performed as compared to E(D). Of 284 failures, 
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there were 24 ties and of the remaining data, E(D) outperformed D* 169 times. Excluding ties, 
and considering the experiment as a binomial, we have the following hypothesis scheme: 

H 0 : The performance of D* and E(D) are the same. 

H a : The performance of 0 * and E(D) differ. 

The test data yielded a standard deviation of 8.06 and a mean of 130. Comparing 169 to the 
mean of 1 30, we have a Z (the standard normal random variable) of 4.83 which indicates we re* 
ject the null hypothesis at an alpha level of less than 0.005. Furthermore, calculating the m an 
square error (M.S.E.) of both estimates, we And M.S.E.(D*> • 0.01826 and M.S.E.(E(D» ■ 

0.01 171. Since M.S E.(E(D)) < M.S.E.(D*), we conclude that E(D) outperforms D*, based on 
the available spacecraft data. We aiso conclude that it is feasible to use E(D) in estimation for 
U for GSFC data. 


The following theorem gives a mathematical justification of the previous observed results. 

Theorem : if X is a random variable, then the best way to measure X by a single constant, 

a, is to choose a * E(X). Here, best is defined as minimum mean square error, 
n 

Proof: Let f(a) (Xi -a) 2 . 

i-t 


Taking derivatives, we have 


II 

f (a) ■ 2 £ (Xj - a). 


i-i 


■a m 

Setting f(X) ■ 0 and applying the summation implies EvE.-o 

i-i i-i 


Since 


a « na, 
i- 1 


we have 


Since 


a * " H Xi * E (X). 

n i-i 


f''(a) > 0, a ■ E(X) minimizes f(a) 


Q.E.D. 
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The Kruger-Norris report (3| established ar functional relationship between D* and the 
number of components given by equation (I-I4) of 13] as D* ■ 0.237 exp (-0.0086N) 
where N if defined as the number of components and I) 1 * is toe measure of criticality. A 
similar binomial comparison was conducted on data from thr same 3 1 spacecraft from PRC as 
mentioned above using the hypothesis that D* is a function of the number of components. 

Making a similar binomial comparison as was done pi viously, c(D) outperformed D* as 
given by equation (I- 14' of [31 215 times out of a possible 284 times. Performing the appre 
priate hypothesis test, as before, we reject the null hypothecs that E(D) and D* have the same 
performance at an a-level at or less than 0.005. The M.S.E. of D* is much larger than the 
M.S.E. of E(D); 

M.S.E.(E(D» ' ■ 0.01171 < M.S.E.(D*) - 1.044. 

As shown by the theorem, die best way to predict a random variable X by a single value is 

to choose the predictor “a" as the expected value of the random variable. This means that a ■ 

E(X) or that “a’* is an appropriate measure of central tendency of the random variable X. The 

theorem and numerical results implies that for any values of the random variable X; (Xj . X 2 

n 

Xn), Xj/n, is the best single predictor for the overall collection of values considered, both 

i- l 

as a total collection or as a subcollection such as the 3 1 spacecraft in PRC data. Hence, if we 
consider the totality or any subcollection of spacecraft failures and classify them according to 
their criticalities, we would choose E(D) as the overall single appropriate measure of a criticality 
value. This means that the instantaneous utility, U, is estimated as 0-n 0 - E(D)) n ‘. Two 
questions remain about the estimation procedure, ( 1 ) by a dependence relationship such as given 
in equation (1-14), can one gain predictability and (2) what is the value of E(D) used in the es- 
timation procedure? 

For any subcollection of spacecraft we have just shown that E(D) gives better predictability 
then £>*, on the basis of closeness of the prediction and M.S.E. of the estimates. 
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For a complete answer to question ( I >. one must examine if on the basis of some casual de- 
pendence such as found in equation (1-14) one gains predictability. To accomplish this, we con- 
sider the collection of spacecraft as a single group and compute EiD). After computing E(D>, 
we compare the performance of E(D) to the performance of D*. equation (I- 1 4) for each 
spacecraft. 

The above study yielded the following results. D* outperformed E(D) 162 times out of a 
total of 284. Using a similar test as before, we reject the null hypothesis that E(D) and D* have 
the same performance at the a ■ 0.0S level. It should be remarked that the M.S.E.fE(D)) > 
M.S.E.fD*), since M.S.E.(E(D)) » 0.055 > M.S.E.fD*) - 0.044. 

This result points to a complexity factor in determining overall criticality. Since critical- 
ity is dependent on the number of components that make up a spacecraft, this dependence 
can be used to gain predictability. This result also points to a need to ascertain a more refined 
measure of the complexity of a spacecraft, since the measurement of complexity enters into the 
formulation of utility which is a measurement essential to measuring the performance of 
spacecraft and the amount of information a spacecraft gains on any particular mission. 

In order to answer question (2), we turn to the development of confidence intervals for E(D). 
When it is necessary to give a confidence statement about the amount of information one obtains 
on any particular mission, it is necessary to bound E(D) or D* in the measurement for utility. 
Since E(D) lends itself to this type of bound more readily than D*, but D* outperforms E(D), it 
is necessary to adjust E(D) to make it perform as well as D*. 

Another form of variability in the system defined by equation (5) comes from the distribu- 

L Yj 

Dj (P(D t )). We observe that P(Dj) ■ — ■ Pj where Yj is defined to be 
iefl ** 

the number of occurrences of the i th type of anomaly. The statistic 2 1* A P(Ity can be written 

left 

as 
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n ■ t '>, (~) 
rl \ n ) 


where n designates the totality of failures for all spacecraft. 


(01 


Thus Y n is a statistic that measures E(D) for a collection of spacecraft. We also observe 
that the expected value of Y n is, since E( Yj) ■ n P t , 


E(Y n ) 




(7) 


To distinguish between the role that n plays for the totality of failures for all spacecraft and the 
rrie nj plays for any single spacecraft j, we define Y n ^ for a single spacecraft as 



( 8 ) 


we further observe that 



where is the information based only on the j 1 * 1 spacecraft. 


(9) 


Equations (7) and (9) imply that the expected value of the statistic Y n ^ is different for dif- 
ferent subclasses of spacecraft. It is noted that this is an a priori measurement based on the 
totality of the information that one has about all previous space flights; at present P t ■ 0.02, 

P 2 * 0.02, Pj ■ 0.1 1, P 4 ■ 0.85 on 449 anomalies for 57 GSFC spacecraft and Dj’s are subjec- 
tively chosen. As information is gained and the nature of the mission better known, the Pj's 
and the subjective definitions of the Dj’s should be re-evaluated. 


Bounding the Statistic; Confidence Intervals 

In order to place bounds on the statistic D; Pj, we outline two approaches. One ap- 

i 

proach is given in Briemann [5| and involves constructing simultaneous confidence intervals for 
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Pi’s from the individual confidence intervals for the Pi’s. This approach allows for dependence 
which we have in our system. The following definitions and theorems follow Briemann. 
Definition : In a K -parameter problem, the intervals J|(6), . . . , 1^(6) are said to form 
simultaneous 100 7 % confidence intervals if 

P$ [0 1 e Jj (6 ), .... djjeJjj (d)J 7 for all 0e(6). 

To obtain simultaneous 100 7 % intervals, we have the following proposition: 

Proposition : If Jj (6) (6) individually are 100 7 % confidence intervals, then they 

form simultaneous 100 [ 1 - K (1 -7)) % confidence intervals. 

For the data given by Table 1, them are K ■ 4 criticalities and four Pj’s on which to con* 

struct confidence intervals. To obtain 90% simultaneous confidence inteivals for Pj, P 2 , P 3 , P 4 , 

a 

we choose Z a/2 ■ 2.24, 7 ■ 0.975, (y * 0.0125). If we construct 95% confidence intervals for 
any single estimate Pj, 7 " 0.95 and we obtain (1 - K (1 - 7)) % or 80% simultaneous confidence 
intervals for (Pj, P 2 , P 3 , P 4 ). 


After simultaneous confidence intervals are obtained for (Pj, P 2 , P 3 , P 4 ), we may obtain 
simultaneous confidence intervals for E(D) and E(Dp; where E(D) denotes the expected criticality 
for cumulative spacecraft failure data and E(Dj) denotes the expected criticality for any single 
space flight mission. The following arc simultaneous a priori confidence intervals for P p P 2 , P3, 
P 4 , where n denotes the totality of failures for all spacecraft 1 - Pj ■ Qj. 


" ^a/2 



^ Pi ^ + Z 


a/2 



( 10 ) 


where ■ 0.02, £ 2 a 0.02, 1* 3 * 0.1 1, £ 4 = 0.85, and a is determined as previously discussed. 


Using the above confidence intervals for Pj we have the following confidence intervals for 


E(D) and E(Dp. 




Pi - z, 


a/2 



£E(D)£ 




( 11 ) 
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These relationships hold for any set or subset of Spacecraft. 

As an example, we calculate the 90% confidence intervals for P|, Pj. ** 3 » using n ■ 400, 

100 , 10 . 


For n ■ 400: 

0.02 - 2.24 


For n * 100: 


it Pj £ 0.02 + 2.24 

0.02 - 0.016 <; g 0.02 + 0.016 
0.004 £ £ 0.036 

0.004 £ P 2 £ 0.036 
0.11 - 0.035 £ P 3 £ 0.11 + 0.035 
0.075 <J P 3 £ 0.1435 
0.85 - 0.04 <, P 4 £ 0.85 + 0.04 
0.81 £ P 4 £ 0.89 



(0.02) (0.98) 
400 


max (0, 0.02 - 0.031) £ £ 0.02 + 0.031 

0 £ Pj £ 0.051 
0 <, ? 2 £ 0.051 

0.11 - 0.070 £ P 3 £ 0.11 + 0.070 
0.04 £ P 3 £ 0.18 
0.85 - 0.08 £ P 4 <, 0.85 + 0.08 
0.78 <, <, 0.93 

For n * 10: 


max (0, 0.02 - 0.099) <, P, £ 0.02 + 0.099 

0 £ P! £ 0.119 
0 £ P 2 £ 0.119 

max (0, 0.11 - 0.22) <, P 3 £ 0.11 + 0.22 
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0 £ Pj £ 0.33 

0.85 - 0.25 £ P 4 £ min (I, 0.85 + 0.25) 

0.60 £ P 4 £ 1 

We next proceed to calculate confidence intervals for Eq)(D) for the given sample size n ■ 
400 and for the various values of the range of D such as maximum, upper quartile, middle, lower 
.quartile, and minimum. In this notation E (n (D) denotes the maximum range of criticality of i 
failure, E (2) (D) denotes tiie upper quartile, E (3) (D) denotes the middle, E (4) (D) denotes the lower 
quartile, and E (5) (D) denotes the minimum. Thus, when we use the dependence between number 
of components and criticality of a failure, we establish a relationship to assign Eq)(D) to measure 
criticality as a function of the number of components. The relationship we use is the greater the 
number of components, the greater value of j we use. This relationship will be explored after 
another method to establish bounds for E(D) is discussed. 

For n * 400; 

0.178 - 0.052 <> E (1) (D) £ 0.178 + 0 052 
0.126 £ E (n (D) <, 0.230 
0.143 - 0.0424 <> E (2) (D) £ 0.143 + 0.0424 
0.101 £ E (2) (D) <, 0.187 
0.109 - 0.039 <, E (3) (D) ^ 0.109 * 0.039 
0.070 £ E (3) (D) £ 0.148 
0.078 - 0.032 £ E (4) (D) <, 0.078 + 0.032 
0.046 £ E (4) (D) ^0.110 
0.039 - 0.026 <, E (S) (D) ^ 0.039 + 0.026 
0.013 £ E (S) (D) ^ 0.065 

One notes that the confidence bands for E (3) (D) actually contain all of the E(D)’s of the data 
from PRC’s 31 spacecraft.* 

•One may not bound P| by a number lower than zero, or bound Pj above by a number greater than 1. 
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Another approach for confidence intervals involves using the multivariate normal distribution. 

This approach incorporates the variance of the statistic Dj Pj into the variance - covariance 

l 

structure for the multivariate normal structure of the Pj’s. In order to develop confidence inter* 

vals for ^ D|, Pj, we give some preliminaries. 

1 


Definition: 


Let 


°n °n 

a in 

°12 a 22 • 

• °2n 


( 12 ) 


L a in a 2n • • • a rn 

Where Ojj ■ oj 2 which are the variar.ee terms and ay are the covariance terms. The matrix V is 
called the variance - covariance matrix. 


From Mood and Graybill (61, ft * — , i * 1, . . . , 5, are the maximum likelihood estimates 

n 

of P, which are used to define E(D) and E(Dj). It is well known that the joint distribution f , 

P 2 , . . . , f 5 ^ is approximately normal with means Pj. Lehmann [7] , Theorem 14, appendix, 
states that a multivariate normal distribution is completely specified by its means and its covari- 
ance structure. We thus have 


®u <Pi> 


M, 


;& » 1 - ft 


and 


ay (ft, fy * cov (Pj, fy ■ - 


ft -ft 


(13) 


These are the exact variances and covariances for any sample size n. This means that we can cal- 
culate bounds for the statistic Dj Pj for the number of failures for all spacecraft and study 

i 

the behavior of any particular spacecraft as a member of its family. 
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The following result from Ho?g and Graig [8], will be used to establish confidence intervals 

for 2^ Di Pj. Let Xj, X 2 X n have a multivariate normal distribution with matrix n of 

i 

means and positive definite variance - covariance matrix V. Consider a linear function Y of Xj , 

. . . , X„ which is defined byY-CT-X-^CjXj, where C 1 • [Cp . . . , C n ) . 


Theorem : The random variable Y is CTVC). That is, it is normally distributed with 

a mean of Cty and a variance C T VC. 

To adapt this to our situation, let 


Pi 


's' 

p 2 

; X - 

h 

A 

P3 


P 3 

P4 

m m 


A 

lAI 


CT ■ [Dp D 2 , D 3 , D 4 ](j)* 


^1 3l “^1 ^2 ~^1 ^3 -^1 ^4 
n n n n 

~^1 ^2 ^2 ^2 ~^2 ^3 ~^2 ^4 

n n n n 

~^1 ^3 ~^2 ^3 ^ 3 ^3 ~^3 ^4 

n n n n 

~^2 ^4 ~^3 ^4 ^4 $4 

n n n n 


(Note: * denotes the level such as minimum, maximum, middle, etc..) 
Thus, we have 


Y « C T X 


[Dp D2, Dj, D4I 


S 

h 

S 

K 


E Dis- 


using the normality of Y, we have the following confidence intervals forE Di ' Pr*Dj) or E(D). 
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C*H - Z o!2 y/ C* VC £ E(D) £ C T M + Z a /2 v/CT'VC 

As an example of the overall calculation of a 90% confidence interval, for E(D), we consider 
n ■ 10 and (i) ■ middle. 


We thus have 


0.02 

0.02 

0.11 

0.8S 


,CT 


[0.95,0.70, 0.30, 0.05), 


V 


0.00196 

-0.00004 

- 0.00022 

-0.00170 


-0.00004 

0.00196 

- 0.00022 

-0.00170 


- 0.00022 

- 0.00022 

0.00979 

-0.00935 


-0.00170 

-0.00170 

-0.00935 

0.01275 


; z o/2 


1.65. 


CTX - 0.109 

CIV » (0.00168,0.00118,0.00211,-0.00497) 

C*VC « 0.00281 
yf&VC * 0.0530 

Therefore 

0.109 - 1.65(0.0530) £ E(D) ^ 0.109 + 1.65(0.0530) 
0.021 £ E(D) £ 0.197. 

If n ■ 5, the entries in the matrix V are multiplied by 2 and hence 

CV (5) » [21 CTV (10) * C t V (5) C - [21 C% 0) C = 0.00563 
= yj C^V ( j } C = y/ 0.00563 = 0.0750 


0.109 - 1.65(0.0750) £ E(D) <> 0.109 + 1.65 (0.0750) 
min. (0,0.109 - 0.124)) £ E(D) £0.109 + 0.124 

0 < E(D) £ 0.233. 
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Using E(D) to Estimate D Based on the Dependence Between Criticality and Number of Components 
It has been shown that there is a dependence between the number of components (a meas- 
ure of the complexity of the spacecraft) and the criticality of a failure. Using this dependence, 
one develops a functional relationship to better estimate D in the equation 

U - Fid - D)" 

where D is now a function of component count. 

The same type of relationship may be established using E(j)(D) as used in the section of 
this report dealing with establishing a criterion for goodness of fit. The way this is done is to 
take the 3 1 PRC spacecraft and separate them into S categories, I, II, III, IV, V, depending on 
their component count. For consistency, we match the lowest component counts with category 
I and correspond this with E t (D), since the smaller the number of components the greater the 
criticality of any failure and a similar process for greater component count. Using this technique 
for the 3 1 PRC spacecraft, we have the following correspondences in terms of spacecraft compo- 
nent count, categories, and measures of criticality. 


Categories 

I 

II 

III 

IV V 

Component 

28, 39, 46,46 

52, 52, 52, 52, 

64, 70, 70, 70, 

86,86,86,86, 120,129,129, 

Count 


52, 59 

70, 76, 78 

86,86 130,130,131, 




131,137 

Criticality 
of Failure 

0.178 

0.143 

0.109 

0.078 0.039 


After making these correspondences, we now compare the performances of E(D) and D * 0.204 
e -o.oos 247N. We obtain the following results: E(D) outperformed D * 0.204 e"° 005247N 143 times 
to 141 times out of 284 failures. The M.S.E.’s of the estimates were approximately the same, 
thus there is no significant difference in the performance of E(D) and D as defined above. We 
may use E(D) when we want to calculate confidence bounds for utility, U, or use D for estima- 
tion and cost purposes without loss of performance. Due to the changing character of spacecraft 
in terms of complexity and failure modes, it is advisable to continually study and refine these 
measurements. 
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Procedure to Calculate Confidence Intervals for LKt) » ( I - D*) F (0 

To bound U as given by U(t) ■ (l - where D* denotes the criticality of a failure 

and F(t) denotes the number of failures after time t as in equation I— 13 of reference 3, we 
bound D* by forming bounds E(D) and estimating D* by E(D) as discussed previously. 

Let 

E l (D) £ E(D) £ E 0 (D) (16) 

where E L (D) and EyCD) denote the lower and upper (1 - c) confidence bounds on E(D). To 
bound U(t) with a lower bound corresponds to choosing the upper bound for E(D), since ( 1 - 
E(D)) will be minimal for E L (D). A similar argument applies for the upper bound for U(t). 

Thus, in terms of D* only, we have 

U L £ U (t) £ Uu • (17) 

where 

U L - (1 - Eu(D)) F (0 
and 

Uu - (I - E l (D)) f (0 

for appropriate confidence levels. 

The final consideration is the bounding of F(t), the number of spacecraft failures after an 
orbital time t. Before we bound t, we must determine if the criticality of failures is independent 
of time. If this is the case, then we may bound D* with the bounds for E(D), and bound F(t) 
with appropriate bounds. In order to answer this question, we refer to table I— A— 1 on page I-A-2 
of reference (3) and perform the appropriate X 2 test for independence. At an a-level of 0.01, 
we do not reject the null hypothesis of independence. 

In order to bound F(t), we use the procedure developed by Williams-Kruger, (9) , for com- 
ponent, system, and orbital failure modes, and obtain 

F L (t) £ F(t) £ Fu(t) (18) 
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where F U( F L denote the upper and lower confidence bounds for E(t) where F(t) is the failure 
mode in orbit. This process involves using regression through the mid-points for the upper and 
lower confidence bounds for the Product Limit estimate for F(t). Thus, the upper and lower 
bounds for u(t) are given by: 

(1 - EufDNMO £ U(t) £ (1 - E l (D))M0 (19) 

Conclusions and Remarks 

When one calculates bounds for expected criticality, E(D), the multivariate confidence interval 
approach is preferred because it deals with the dependence of the parameters P t , P 2 , . . . , P n , col- 
lectively through the variance— covariance structure. 

In order to use the multivariate confidence approach for confidence intervals for any set of 
data, one calculates , . . . , P a from that set of data, then finds the matrices V, and C T , finds D, 
and calculates confidence intervals as indicated in the previous discussion. 

The use of confidence intervals is necessary when one uses the concept of utility to determine 
how much time is necessary to gain the pertinant amount of information needed from each mission. 
As a mission is conducted, then one has time intervals in which to gain information. As an example 
we consider the diagram in Figure 1. 


PERIODS DURING WHICH DATA IS AVAILABLE 
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The vertical bars in Figure I indicate the periods when data may be taken, such as when a 
spacecraft is over a ground point. The utility of the spacecraft may be expected to decrease with 
time as malfunctions occur. Therefore, if one needed a specific number of hours worth of infor- 
mation, the observing times would have to be multiplied by the value of U existing during that 
time. 


In order to use the confidence intervals for E(D) with the concept of utility in gaining in* 
formation, one would be interested in using the confidence bounds for E(D) through the minion 
to calculate U. If one wanted 12 hours of information, then one would numerically integrate 
the area in each bar of Figure 1 that is under the curve U using confidence bounds calculated as 
in equation (19). This would give a final estimate for the total number of hours of information 
gained with a degree of confidence based on the bounds for U(t) in equation (19). 

One should continue to study the question of complexity of spacecraft and criticality of 
failures during the mission since these concepts and measurements have a direct bearing on mission 
cost optimization. 
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